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Abstract 

A  first  step  toward  automating  the  process  of  discourse  understanding  is  to  grasp  the  meaning  contents  of  the 
discourse  message,  at  least  the  literal  meaning.  Although  every  utterance  may  be  assumed  to  contribute  something 
to  the  discourse  meaning  as  a  whole,  this  latter  can  only  rarely  be  regarded  as  a  simple  sum  of  meanings  of  com- 
ponent utterances.  Utterances,  or  sentences,  making  up  a  discourse  are  usually  involved  in  complicated  mutual 
dependencies,  that  often  go  beyond  the  text  itself.  A  careful  study  of  these  extra-sentential  and  inter-sentential 
dependencies  in  discourse  is  necessary  before  a  more  successful  attempt  to  design  an  automated  discourse  under- 
standing system  can  be  undertaken.  We  outline  a  fragment  of  the  system  of  semantic  rules  for  computing  coherent 
continuations  at  any  point  in  discourse  by  uncovering  various  links  existing  between  an  utterance  and  its  context 
Next,  we  describe  an  extension  of  the  method  to  handle  changes  in  the  level  of  reference  in  discourse.  In  order  to 
accomplish  this  we  develop  a  multi-level  model  for  representing  and  manipulating  various  types  of  non-singular 
terms.  We  outline  a  possible  application  to  processing  expository  texts  found  in  college  textbooks  on  science  and 
engineering. 

1.  Computing  extra-sentential  dependencies  in  discourse 

A  first  step  toward  automating  the  process  of  discourse  understanding  is  to  grasp  the  mean- 
ing contents  of  the  discourse  message,  at  least  the  literal  meaning.  A  discourse  normally  consists 
of  more  than  a  single  utterance,  and  although  every  utterance  may  be  assumed  to  contribute 
something  to  the  discourse  meaning  as  a  whole,  this  latter  can  only  rarely  be  regarded  as  a  sim- 
ple sum  of  meanings  of  component  utterances.  Utterances,  or  sentences,  making  up  a  discourse 
are  usually  involved  in  complicated  mutual  dependencies,  that  often  go  beyond  the  text  itself.  A 
careful  study  of  these  extra-sentential  and  inter-sentential  dependencies  in  discourse  is  necessary 
before  a  more  successful  attempt  to  design  an  automated  discourse  understanding  system  can  be 
undertaken. 

Suppose  that  in  an  automated  processing  of  a  natural  language  discourse  we  have  reached 
the  stage  where  sentences  (or  utterances)  are  represented  with  parse  structures  in  some  grammar. 
Let  L  be  a  fragment  of  a  language  of  such  parse  structures  that  can  represent  sentences  from  a 
selected  subset  of  English.  L  is  identified  here  with  the  set  of  phrase-markers  that  can  be  gen- 
erated from  English  sentences  with  a  categorial  grammar  CAT  (Montague  1974).  It  is  not  neces- 
sary that  we  take  a  categorial  grammar  to  base  the  syntactic  process  on;  perhaps  some  other  syn- 
tactic system  would  be  more  suitable  in  practice.  Nonetheless  the  simplicity  and  elegance  of 
CAT  make  this  grammar  most  suitable  for  this  presentation.  We  concentrate  on  the  translation  of 
some  example  expressions,  sentences  and  paragraphs  of  L  into  well-formed  formulas  of  a  X- 
categorial  language  A  that  would  give  representation  of  both  a  sentence's  logical  form  and  its 
cohesive  links  to  the  surrounding  discourse.  In  particular,  we  shall  look  closely  at  the  cohesive 
links  created  by  inter-sentential  anaphoric  references  appearing  in  different  contextual  situations. 


'  This  report  is  based  upon  work  supported  by  the  Defense  Advanced  Research  Projert  Agency  under  Contraa  NCXX)14-85-K-0163  from 
the  Office  of  Naval  Research. 


A  formal  definition  of  language  A  is  given  elsewhere  (Strzalkowski&Cercone  1986).  A 
possesses  adequate  expressive  power  to  represent  the  meaning  of  a  considerable  spectrum  of 
linguistic  constructs  found  in  a  natural  language  discourse.  What  is  of  a  particular  interest  to  us, 
A  provides  a  natural  and  uniform  means  for  computing  and  representing  extra-sentential  depen- 
dencies. As  we  shall  see  in  the  next  section,  a  meaning  representation  language  so-defined  is 
still  inadequate  for  capturing  some  more  difficult  cases  which  we  call  remote  co-references. 

Our  present  effort  is  to  describe  a  transformation  ISD  such  that  ISD  c  L  x  A,  and  whenever 
a  source  expression  in  L  consists  of  more  than  one  sentence,  a  class  of  intersentential  dependen- 
cies within  this  fragment  is  identified  and  resolved,  if  possible.  It  must  be  noted  here  that  ISD 
represents  a  semantic  process  which  is  entirely  independent  of  any  pragmatic  or  domain  related 
factors.  As  a  result  a  substantial  amount  of  domain-oriented  ambiguity  may  be  left  unresolved. 
In  any  practical  application,  this  transformation  must  be  accompanied  by  a  pragmatic  process,  as 
described  in  (Strzalkowski  1986).  ISD  consists  of  a  collection  of  translation  rules 
(Ri,  R2,  ■  •  •  j,  such  that  each  rule  is  responsible  for  translating  a  specific  type  of  dependency. 
Actually,  only  Rule  1  works  direcdy  on  expressions  of  L,  translating  them  into  "literal"  represen- 
tations in  A,  independent  of  one  another.  Rules  numbered  2  and  up  will  take  these  "literal" 
translations  and  try  to  relate  them  pairwise  looking,  among  other  things,  for  unresolved  ana- 
phoric references.  Most  of  these  rules  can  be  written  in  terms  of  two  distinguished  expressions  of 
A,  Si  and  52,  which  we  call  the  context-setting  sentence  and  the  current  sentence,  respectively. 
Expression  5 1  is  a  A-representation  of  the  linguistic  context  in  which  the  sentence  with  transla- 
tion 52  is  to  be  evaluated.  Neither  5i  nor  52  must  correspond  to  surface  sentences,  though.  5i 
may  represent  a  larger  part  of  discourse,  perhaps  an  entire  paragraph;  on  the  other  hand,  52  itiay 
constitute  only  a  subclause  of  5i  in  which  case  we  would  talk  of  intra-sentential  dependency.  It 
should  be  noted  here  that  the  potentially  explosive  number  of  possibilities  will  be  in  fact  limited 
by  the  actual  structure  of  the  discourse  under  consideration  (see,  among  others,  Grosz  and  Sidner 
1985),  as  well  as  by  the  pragmatic  and  domain-related  information,  not  discussed  here. 

Let  us  now  consider  a  two  sentence  paragraph  given  below: 

5 1 :  John  interviewed  a  candidate. 
S2'  The  guy  had  impressive  references. 

In  the  most  natural  reading  of  this  paragraph,  the  anaphor  of  the  guy  is  resolved  against  a  candi- 
date in  the  first  sentence,  so  that  the  second  sentence  actually  means:  the  guy  whom  John  inter- 
viewed had  impressive  references.  This  inter-sentential  dependency  is  captured  by  the  transla- 
tion rule  2,  which  operates  on  the  "hteral"  translations  of  both  sentences  as  delivered  by  Rule  1 
(Strzalkowski  &  Cercone  1986). 

Rule  2  (Perfect-Context  Translation  Rule) 

If  the  context-setting  sentence  5)  has  a  referential  interpretation  in  the  form  3"  [^(")  <^  F'iu)],  and  the  current 

sentence  S2  contains  an  unresolved  definite  anaphor,  that  is, 

S2  =  3u  [C{u)  &P^{u)  &  F^iu)  &  \fx  [{Piix)  &  Cix)}^(x=u)]l' 
then  this  anaphor  can  be  resolved  against  S  j ,  and  the  resulting  translation  0/S2  is  obtained  as 
y^[S2](Ku[P{u)&F{u)]). 


^  C  is  a  free  predicate  variable  thai  can  be  bound  by  the  sentence's  context.   It  has  been  introduced  by  Rule  1  with  the  translation  of  the 
definite  article. 


In  the  example  above,  the  second  sentence  obtains  the  desired  translation  as  shown  below 

3^  iSt^ix)  &  cand{x)  &  int(J,x)  &  had-imp-ref  {x)  & 
V/y  Uguyiy)  &  candiy)  &  int(J,y)}  =>  ix=y)]] 

A  somewhat  different  problem  arises  when  we  consider  a  fragment  with  a  possible  non- 
referential  interpretation,  as  in 

John  wants  to  marry  a  queen.  The  girl  must  be  rich  and  pretty. 

Now,  Rule  2  can  compute  the  anaphoric  link  between  the  girl  and  a  queen  only  if  both  sentences 
receive  their  referential  interpretations.  In  case  where  both  sentences  are  understood  non- 
referentially,  we  have  to  use  Rule  3,  given  below.  No  other  combinations  are  possible. 

Rule  3  (Imperfect-Context  Translation  Rule) 

If  the  context-setting  sentence  Sj  has  a  non-referential  interpretation  in  the  form  imp  Qu  [P(u)  &  F(u)]),  ^  where 
imp  is  an  imperfect  operator,  and  the  current  sentence  S2,  also  in  a  non-referential  interpretation,  contains  a 
definite  anaphor  which  occurs  in  scope  of  an  imperfect  operator  impi ,  i.e., 

S2  =  imp,Qi  [C{u)&P:iu)&F^(u)&\ix[{P:(x)&C(x)}^(x=u)]l 

then  this  anaphor  can  be  resolved  against  S  \ ,  with  the  resulting  translation  ofS2  derived  as 

XC[S2]{Xu[P{u)&F(u)]). 

Rule  3  encompasses  a  large  class  of  non-referential  contexts,  which  we  call  imperfect  contexts, 
and  which  involve  constructs  including  propositional  attitudes  (want,  try,  wish),  intensional 
verbs  (seek,  conceive,  think  about),  other  complement-taking  verbs  (go,  come),  modal  verbs 
(must,  can,  will),  as  well  as  progressive  tense  forms.  In  the  non-referential  interpretation,  the 
second  sentence  of  the  fragment  given  above  will  be  translated  with  Rule  3,  resulting  in  the  fol- 
lowing formula 

must(^  [girl(x)  &  queen  (x)  &  marries  (J, x)  &  rich(x)  &  pretty  (x)  & 
'^y  Ugii'liy)  &  queen  (y)  &  marries  (J ,y)}  Z)  (x=y)]]) 

Other  studied  cases  of  inter-sentential  anaphora  (see  Strzalkowski  1986a-c,  Strzalkowski  &  Cer- 
cone  1986)  include  non-referential  interpretation  of  discourse  fragments  involving  attitude  report 
verbs  (believe,  know,  disagree).  These  cannot  be  translated  with  Rule  3,  and  a  new  rule.  Rule  4, 
is  developed  to  compute  anaphoric  links  in  texts  similar  to  the  one  given  below. 

John  believes  that  a  unicorn  lives  in  the  park. 
He  thinks  the  creature  has  a  long  horn. 

Rules  5,6  and  7  account  for  the  pronominal  anaphora.  Rule  10  deals  with  certain  instances  of 
attributive  use  of  definite  noun  phrases.  Rules  8  and  9  are  used  when  the  antecedent  of  an  ana- 
phor is  a  proper  name  rather  than  a  description.  This  is  the  situation  where  an  interesting  type  of 
referential  ambiguity  occurs  whose  resolution  may  have  far  reaching  consequences  on  the  pro- 
cess of  discourse  understanding.  In  the  following  fragment 

Sylvester  tries  to  catch  a  bird.  The  cat  is  clumsy. 

there  are  two  possible  ways  of  linking  the  cat  with  Sylvester.  In  one  reading,  not  very  different 
from  those  processed  with  Rule  2,  the  definite  anaphor  refers  primarily  to  the  entity  which  can 
be  described  as  the  one  who  tries  to  catch  a  bird,  and  only  contingently  to  its  name.  In  this  case 
we  acquire  some  new  information  about  Sylvester,  namely  that  it  is  a  cat.  In  the  other  possible 

'  Here  imp  stands  for  a  compound  operator,  classified  into  category  (l/e)A,  such  as  John  wants. 


reading,  the  anaphor  refers  to  the  name  only,  and  thus  may  draw  on  some  context  which  is  dif- 
ferent from  the  first  sentence  in  the  fragment.  This  latter  situation  is  handled  by  Rule  9. 

Rule  9  (Names  as  Ultimate  Referents) 

If  the  context-setting  sentence  S  j  has  the  form  ofF  i  (N)  where  N  is  an  individual  constant  denoting  a  name,  and  the 

current  sentence  S2  contains  a  definite  anaphor.  so  thai  its  literal  translation  has  the  form 

S2  =3x  [P(x)  &Cix)&  F2{x)  &  \fy  [{P(y)  &C(y)}i^  (x=y)]]. 
then  the  anaphor  can  be  resolved  against  N  as  its  ultimate  referent  with  the  following  derivation: 

Xp  [p  {N)](hc  [XC  [S2\(Xs  [N{sm) 
where  N  is  the  predicative  use  of  name  N. 

In  the  above  fragment.  Rule  9  would  produce  the  following  translation  for  the  cat  is  clumsy  (S  is 
an  individual  constant  denoting  the  individual  named  Sylvester): 

cat(S)  &  SyliS)  &  clumsy  (S)  &  \fx  [{cat(x)  &  Sylix)}  z>  (x^S)] 

There  are  more  aspects  of  this  transformation  that  merit  attention.  These  include  rules  for  deal- 
ing with  other  kinds  of  anaphora  not  discussed  here,  elliptical  constructions,  enumerably  singular 
(plural)  terms,  intra- sentential  anaphora  and  non-anaphoric  dependencies,  as  well  as  indirect 
and  forward  reference  cases  where  access  to  the  speaker/hearer  knowledge  base  may  be 
required.  We  also  have  to  deal  with  the  changing  reference  level. 

2.  Non-singular  terms  in  discourse 

The  rules  discussed  in  section  1  cover  selected  cases  of  inter-sentential  anaphora  where  the 
reference  level  in  discourse  does  not  change  from  one  sentence  to  another.  There  exists,  how- 
ever, a  class  of  inter-sentential  dependencies  whereby  a  reference  is  made  across  boundaries  of 
different  reference  levels  in  discourse.  For  example,  in 

My  new  pet  is  an  alligator.  But  the  alligator  cannot  live  in  our  climate. 

the  alligator  in  the  second  sentence  most  likely  refers  to  a  generic  object  of  which  the  alligator 
in  the  first  sentence  is  an  instance  or  extension.  Thus  we  can  say  that  the  second  alligator  is  a 
non-singular  superobject  in  which  the  first  alligator  somehow  participates.  The  extent  of  such 
participation  is  not  clear,  but  in  general  it  can  be  observed  that  certain  predications  true  of  com- 
plexes of  different  kind  are  not  preserved  for  their  parts  or  elements,  and  vice-versa.  To 
represent  this  new  kind  of  inter- sentential  dependency  we  introduce  a  multi-level  model  for 
interpreting  natural  language  expressions,  such  that  the  levels  in  the  model  would  correspond 
(roughly)  to  the  levels  of  reference  in  discourse.  For  instance,  in  the  example  above,  the  result- 
ing representation  would  have  both  alligators  placed  at  different,  though  related,  "object  levels". 
Because  of  an  inherent  subjectivity  of  such  classifications,  the  levels  in  the  model  may  have 
fuzzy  boundaries  and  are  only  partially  ordered  with  the  lower  than  (i.e.,  more  detailed  than) 
relation  with  respect  to  some  current  level  (corresponding  to  the  level  of  reference  at  a  present 
point  in  discourse). 

The  basic  concepts  of  the  theory  are  the  notions  of  a  singular  object  and  a  coordinate,  a 
usually  ordered  set  specifying  a  type  of  "dimension"  that  the  object  in  question  spans.  The  most 
common  of  these  coordinates  are  time  and  space  but  other  more  abstract  ones  are  also  possible. 
These  two  basic  concepts  are  then  used  to  define  the  notion  of  the  object's  instance  with  respect 
to  some  coordinate.  Thus,  the  pet  alligator  in  the  example  above  is  related  to  the  generic  con- 
cept of  alligator  by  some  "species"  coordinate  that  somehow  ties  (or  enumerates?)  all  alligators 
around  the  world.  If  we  reverse  this  process  we  can  combine  objects  into  complexes  to  which 
we  can  subsequently  refer  using  collective  terms,  singular  or  plural,  such  as,  for  example,  people 
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or  the  man  (generic).  The  lower  than  relation  between  levels  in  the  universe  model  derives  from 
expanding  the  notion  of  instance  over  collections  of  objects.  The  relation  introduces  a  partial 
ordering  within  the  universe  model  and  thus  helps  to  trace  changes  in  the  reference  level  of 
discourse.  The  highly  discrete  approach  taken  here  is  favorably  contrasted  with  other  existing 
approaches  to  non-singular  terms,  including  (Quine  1960),  (Kripke  1972),  (Montague  1974), 
(Carlson  1982)  and  others.  While  insights  of  Quine,  Kripke  and,  perhaps  even  more  so,  Carlson 
are  undoubdy  of  great  influence,  they  require  reworking  in  more  discrete  terms.  Finally,  we  may 
note  that  the  research  in  Anificial  Intelligence  and  Computational  Linguistics  has  devoted  rela- 
tively littie  attention  to  treatment  of  non-singular  terms  in  natural  language  in  general  and  in 
natural  language  discourse  in  particular;  see,  however,  (Sidner  1979)  for  some  early  attempts  to 
recognize  generics  in  discourse.  One  of  the  goals  of  the  present  research  is  to  fill  this  gap. 

3.  A  multi-level  model  for  interpreting  natural  language  terms 

Initially,  we  note  that  our  language  tends  to  deal  with  singular  objects  only,  no  matter  how 
complex  their  structure  happens  to  be.  A  singular  object  is  therefore  any  entity  that  can  be  taken 
as  a  coherent  whole,  in  other  words,  it  can  be  referred  to  direcUy  using  a  referring  expression  of 
language:  a  name,  a  definite  description,  a  pronoun.  Thus,  at  least  as  far  as  our  ability  to  refer  is 
concerned,  all  objects  appear  singular.  Still,  it  is  not  the  case  that  all  objects  are  singular  in  the 
same  way.  Take,  for  example,  two  persons  John  and  Mary.  They  are  singular  objects  and  they 
seem  singular  in  the  same  way,  in  other  words,  singular  relative  to  one  another.  Next  take  alliga- 
tor, the  species,  and  the  alligator  John  owns.  Although  both  are  singular  in  their  own  right,  they 
are  not  compatible  when  related  to  one  another:  the  alligator  John  owns  appears  only  a  manifes- 
tation, or  extension,  of  alligator  the  species  at  a  certain  space-time  location. 

Let  us  introduce,  only  intuitively  at  first,  the  relation  of  relative  singularity  among  objects, 
as  suggested  above.  This  relation  will  help  us  to  break  down  the  universe  of  objects  into  classes 
of  relatively  singular  objects,  which  we  call  levels.  The  levels  can  be  subsequently  partially 
ordered  with  lower  than  relation,  i.e.,  L\<L2,  indicating  that  level  L\  consists  of  manifestations 
(extensions,  instances)  of  objects  at  level  L2.  Let  Lq  be  an  arbitrary  level  we  select  as  our  refer- 
ence point;  if  our  discourse  operates  at  this  level  then  Lq  defines  the  current  level  of  reference  of 
the  discourse.  Let  L+i  and  L_i  be  two  other  levels  different  than  Lq  and  such  that 
L_i<Lo<L+i.  At  level  L+\  we  place  the  objects  we  consider  to  be  generalizations  (or  abstrac- 
tions) of  some  measurable  amount  of  objects  from  Lq.  It  is  only  from  the  perspective  of  L+i 
that  we  are  able  interpret  The  tiger  lives  in  the  jungle,  or  The  president  is  elected  every  four 
years,  or  Birds  can  fly,  or  Tourists  start  forest  fires.  The  objects  at  L+\  are  singular  but  only 
when  related  to  one  another  within  the  same  level;  when  viewed  from  Lq  they  appear  "generic" 
or  "functional"  or  the  like,  in  other  words,  non-singular.  Non-singular  objects  may  not  have 
corresponding  measurably  singular  descriptions  at  Lq  (like  every  tiger,  some  president,  etc.),  and 
often  it  will  not  be  possible  to  refer  to  them  in  the  terms  of  the  language  available  at  Lq.  Thus, 
while  the  statement  of  The  President  lives  in  the  White  House  interpreted  at  level  L+\  can  be 
argued  to  be  equivalent  to  the  statement  Every  president  lives  in  the  White  House  interpreted  at 
Lq,  the  same  cannot  be  said  of  The  tiger  lives  in  the  jungle  and  Every  tiger  lives  in  the  jungle. 
We  must  note  that  some  objects  found  at  L+i  could  have  been  placed  there  by  design  rather  than 
as  a  result  of  generalizing  from  Lq;  an  example  of  such  higher-level  object  may  be  The 
President. 

If  level  L+i  contains  generalizations  of  objects  from  Lq,  then  level  L_i  will  contain  their 
specializations  or  extensions.    Descending  upon  L_i   we  can  see  that  what  we  previously 


-5 


considered  to  be  the  atom  actually  denotes  many  different  kinds  of  atoms  (H,  O,  Ca,  Fe,  etc.),  or 
that  the  mail  is  not  the  same  every  morning. 

A  few  definitions  will  help  to  put  the  above  intuitions  into  a  more  formal  setting. 

Def.  1.  A  use  of  a  description  is  called  singular  if  it  refers  to  a  singular  object.  A  use  of  a 
description  will  be  called  measurably  singular  if  it  refers  to  some  measurable  quantity  of  a 
singular  object;  otherwise  we  shall  talk  of  non-singular  use. 

Def.  2.  An  object  level,  or  simply  a  level,  is  an  arbitrary  collection  of  relatively  singular  objects. 
On  the  language  side,  the  corresponding  reference  level  encompasses  those  singular  and 
measurably  singular  uses  of  descriptions  that  refer  to  the  level's  objects. 

Def.  3.  For  any  level  L„,  there  are  at  least  two  distinct  levels  L„_i  andL^+i  such  that  L„+i  con- 
tains the  non-singular  objects  as  seen  from  L„,  and  L„_i  contains  the  objects  for  which  the 
objects  at  L„  are  non-singular. 

Def.  4.  The  level  Lq  is  an  arbitrarily  chosen  level  serving  as  a  reference  point. 

As  described,  the  structure  of  levels  is  not  yet  adequate  to  capture  the  full  complexity  of  the 
reference  structure  of  discourse.  A  notion  of  coordinate  has  to  be  introduced  along  the  following 
lines.  We  shall  call  T  a  coordinate,  if  7  is  a  set  of  "points"  or  "locations"  at  which  certain  gen- 
eral (or  abstract)  objects,  for  example  the  president  or  the  atom,  are  assigned  more  specific 
extensions  or  instances,  such  as  President  Reagan  or  H,  Fe,  Ca,  ....  A  coordinate  is  usually  an 
ordered  set  though  the  ordering  may  be  partial  only.  Almost  any  object  we  can  think  of  appears 
an  instance  of  a  more  general  concept,  and  often  there  will  be  more  such  concepts  available,  if 
we  consider  different  coordinates.  Water  in  a  glass  is  an  instance  of  some  totality  of  water  in  the 
universe  (space  coordinate),  and  also  an  instance  of  a  concept  of  water  as  in  water  boils  at  100 
degrees  Celsius.  These  examples  suggest  that  a  coordinate  is  usually  a  large  set,  often  an  infinite 
set,  though  perhaps  no  more  than  recursively  enumerable.  A  non-singular  object  can  be  decom- 
posed into  instances  in  more  than  one  way,  depending  which  coordinate  is  used.  Let  L_j  be  the 
le>el  where  we  place  the  instances  of  object  N  decomposed  with  coordinate  T.  By  analogy,  we 
define  L+i^  to  be  the  level  such  that  for  any  object  M,  M  e  L+i^  if  N  e  L^i^.  In  other  words, 
L+i^  contains  the  superobject  M  generalizing  over  object  N  with  the  use  of  coordinate  T. 

Suppose  that  we  have  an  object  N  called  N  at  level  Lq.  Suppose  further  that  coordinate  T  is 
selected  so  that  for  any  x,  y  €  T  wt  have  that  N-at-x  ^t  N-at-y.  Let  us  use  N^  to  stand  for  N-at-;c, 
where  x  is  an  element  of  T,  and  let  (N  x)  be  an  expression  in  our  meaning  representation 
language  that  refers  to  (or  denotes)  object  N;c,  whenever  an  expression  N  refers  to  N.  We  obtain 
therefore  that 

\f  x,ysT  [x^y  3  (N  x)  ^  (N  y)] 

The  new  objects  N;('s  cannot  be  placed  at  Lq  because,  being  instances  of  N,  they  are  not  singular 
relative  to  N  (see  Def.  2).  Instead,  we  move  them  onto  a  new  level  L_i  leaving  the  original 
object  N  at  Lq.  We  say  that  the  level  L^j^  is  lower  than  the  level  Lq,  and  write  L^i  <Lq.  Often 
we  drop  the  superscripts  N  and  T  over  the  level  symbol,  assuming  some  lower  level  L_i,  when- 
ever it  does  not  lead  to  ambiguity. 

As  an  example,  let  us  consider  a  rather  naive  concept  of  bird,  B,  as  that  of  a  winged 
creature  that  lay  eggs,  and  place  it  at  Lq.  Using  a  genus  coordinate,  G,  we  can  construct  a  level 
L^f'  containing  such  objects  as  eagle,  hawk,  goose,  and  penguin.  There  is  another  way 

of  interpreting  concept  B  as  well:  we  introduce  a  specimen  coordinate  S  that  allows  us  to  pick  up 
specific  birds,  such  as  Opus,  the  penguin,  at  level  L^f .  Note  that  this  level  is  lower  than  L_i 
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because  it  contains  all  levels  L^\^' ,  where  X  ranges  over  objects  at  L?i^,  and  S'^.  Now  we 
can  attempt  to  represent  meanings  of  some  simple  statements  about  birds.  For  example,  Birds 
can  fly  is  represented  at  Lq  as  can-fly(B),  while  Opus  is  a  bird  would  translate  as  3^€5  [(B  s)  = 
Opus].  We  cannot  infer  from  these  statements  that  Opus  can  fly;  indeed,  Opus  cannot  fly,  which 
translates  to  — ican-fly(Opus),  is  not  necessarily  inconsistent  with  the  above  two. 

A  process  reverse  to  decomposition  is  that  of  ascending  to  a  higher  level  within  the  level 
hierarchy.  Suppose  that  for  some  objects  Nj,  N2,  •  •  • ,  considered  distinct  at  Lq,  we  discover 
they  share  a  certain  property,  such  as  being  an  N,  so  that  we  need  a  generalizing  concept  to  talk 
about  them.  We  pick  up  a  coordinate  T,  and  climb  onto  some  higher  level  L 1 ,  that  is, 
Lq=L^{^  <L+{'  =Li,  and  establish  a  new  object  N  there,  a  superobject.  Now,  as  viewed  from 
L 1 ,  all  N,  's  are  just  the  occurrences  of  N  at  different  values  of  coordinate  T.  It  is  important  not 
to  confuse  a  superobject  with  a  set  S  of  its  instances  at  Lq  that  gave  birth  to  this  superobject.  A 
superobject  N  can  be  identified  with  a  family  of  functions  {Nt-  I  T  is  a  coordinate}  such  that  each 
N7  is  a  function  from  coordinate  T  into  an  appropriate  lower  level,  L_\  .  In  particular,  a 
superobject  N  at  L 1  can  be  viewed  from  Lq  as  a  function  Nj-  from  T  into  Lq  such  that,  whenever 
seScLo,  then  there  is  re  7  such  that  N7-(r)=N,=s.  The  function  N7  is  then  arbitrarily  extended 
beyond  the  set  S.  The  following  definition  may  be  suggested. 

Def.  5.  Let  L  and  M  be  any  two  distinct  levels  of  relatively  singular  objects.  We  say  that  level  L 
is  lower  than  level  M,L  <  M,  iff  there  exists  an  object  P  at  level  M  and  a  coordinate  T  such  that 
L  2  mY. 

4.  Remote  co-references  in  discourse 

We  now  examine  how  the  foregoing  theory  of  non-singular  terms  could  be  utilized  to 
account  for  some  more  advanced  cases  of  inter- sentential  dependencies  in  discourse.  Let  us  start 
with  an  example  and  consider  the  following  discourse  fragment. 

The  president  J  is  elected  every  four  years.  The  president2  is  Reagan. 

Suppose  that  the  presidentj  and  the  presidentj  are  interpreted  at  levels  Li  and  L2,  respectively, 
so  that  one  of  the  following  takes  place.  EitherLi=L2,  or  L\<L2,  otL2<Li,  or  simply  Li9iL2, 
where  <  stands  for  the  lower-level  relation  introduced  in  Def.  5.  The  latter  case  does  not  interest 
us,  since,  in  such  an  interpretation,  both  sentences  were  uttered  at  different  occasions  with  no 
connection  between  them.  Consider  first  that  L 1  =L2=Lq.  If  the  two  definite  descriptions  were  to 
co-refer  then  we  would  be  talking  of  the  same  object  (individual)  in  both  sentences.  That 
interpretation,  although  possible,  does  not  agree  with  our  intuition.  In  this  case  the  conclusion  of 
Reagan  is  elected  every  four  years  follows  immediately.  Assume  then  that  L2=Z>-i '  <L\=Lq 
where  TP  is  the  object  at  L 1  referred  to  by  the  presidentj,  and  7  is  a  coordinate.  If  the  president^ 
is  used  as  a  name,  we  can  expect  the  following  translations,  respectively: 

elected  -every  -Ayears  (TP ) 
3r[SL(r)&((TPr)=R)] 

where  t  €  T  and  SL  is  a  selector  over  T  provided  by  the  discourse  situation  (for  example  now, 
here,  etc.).  ■*  We  summarize  the  above  as  follows.    In  some  part  of  a  discourse,  a  certain 


*  In  a  more  general  case,  we  would  lake  Ihe  phrase  the  president^  as  an  ordinary  definite  description,  assuming  some  external  context  C 
which  allows  for  the  use  of  the  definite  article  (Strzalkowski  &  Cerconc  1988). 
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(general)  object  X  is  addressed;  that  is,  there  is  some  part,  Sj,  of  the  discourse  (presented  as  a 

single  sentence  in  our  examples,  for  simplicity),  such  that  Sj  predicates  something  of  X  -  that  is, 

Sj(X),  where  X  is  a  description  that  refers  to  X.  In  a  subsequent  part  of  the  discourse,  however, 

the  discourse  changes  the  level  of  reference  and  only  some  instance(s)  of  X  with  resjject  to  some 
coordinate  T  is  addressed;  that  is,  there  is  some  te  T  such  that  S2((X  t)),  where  S-  is  this  new  part 

of  the  discourse.  Apparently,  the  discourse  internal  cohesion  would  be  compromised  if  we  did 
not  allow  the  higher  level  object  X  be  a  target  of  a  remote  reference  by  a  description  (X  t)  denot- 
ing one  of  its  instances.  In  such  a  case  we  say  that  Sj(X)  creates  a  supercontext  for  (X  t).  We 
can  further  say  that  X  and  (X  r)  are  remotely  co-referential.  This  type  of  inter-sentential  depen- 
dency is  captured  by  the  translation  rule  below. 

Rule  11  (Supercontext  Translation  Rule) 

If  the  context-setting  sentence  S^  with  the  translation  -^x  [P,(x)  &  Fj(x)]  is  interpreted  at  level  L^-^,  where  %  is  an 

object  satisfying  sentence  S^  when  interpreted  at  level  Lq,  and  S^  contains  an  unresolved  remote  reference  P.,  that 

is, 

S2  =  3y[P2(y)&F2(y)]. 

then  the  full  translation  ofS^  is  obtained  by 

XQ[XC[MQ^](C,)]()iuO[>^y[P2(y)  &  ^2'^ymn  o)]]), 

where  the  supercontext  C,  is  Xa[Pj(x)  &  Fj(x)],  and  M^^  abbreviates  the  following  expression 
Mqc  =  3x[C(x)  &  Vy  [C(y)  3  (x=y)]  &  Q(x)]. 

A  similar  situation  (though  not  quite  just  a  mirror-image  situation)  occurs  when  an  expression 
addressing  a  higher  level  object  is  used  to  provide  an  inter-sentential  link  to  a  discourse  entity 
that  refers  to  an  instance  of  this  object.  For  example.  Look,  a  tiger!  Careful,  tigers  are 
dangerous  animals.  This  is,  however,  just  the  tip  of  an  iceberg.  One  of  the  important  issues 
which  remain  to  be  worked  out  is  how  to  automatically  determine  when  a  change  of  reference 
level  in  discourse  takes  place.  Surely,  a  bare  pliu^al,  such  as  tigers  indicates  a  higher  level  refer- 
ence, especially  when  co-related  with  a  singular  indefinite  description,  such  as  a  tiger.  Also,  a 
singular  definite  description  when  followed  by  a  co-related  indefinite  description  or  a  definite 
plural,  would  normally  indicate  transition  to  a  lower  reference  level  (The  tiger  has  stripes.  I  saw 
one  in  the  zoo.).  Another  problem  is  to  determine  exactly  what  kind  of  inferences  can  be  made 
along  a  remote  co-reference  link.  At  this  time  we  disallow  any  such  inferences  whatsoever,  to 
avoid  certain  unreasonable  conclusions.  Nonetheless,  in  many  situations  inter-level  inferences 
can  and  should  be  made,  or  we  risk  to  forsake  our  understanding  of  the  discourse.  The  most 
obvious  cases  are  those  of  generic-to-specific  inferences,  whereby  a  property  attributed  to  a 
non-singular  generic  object  (such  as  in  tigers  are  dangerous)  is  reduced  to  a  form  of 
quantification  over  instances  of  this  object  at  a  lower  level.  This  latter  issue  is  addressed  else- 
where (Strzalkowski  1988). 

5.  Processing  expository  texts 

An  application  area  we  have  been  considering  is  the  processing  of  expository  texts,  similar 
in  character  to  those  found  in  college  textbooks  on  science  and  engineering.  The  language  of 
science  textbooks  is  rich  in  the  variety  of  inter-sentential  dependencies,  including  anaphoric 
references  and  remote  references.  The  idea  is  to  do  an  automated  analysis  of  the  logical  struc- 
ture of  such  texts  by  translating  them  into  an  adequately  rich  and  faithful  meaning  representation 
which  could  be   subsequently  used  in  a  deductive/retrieval  process.  This  representation  is 
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expected  to  capture  the  multiple  ways  in  which  the  elements  of  the  text  are  interconnected,  indi- 
cating a  number  of  plausible  interpretations.  Pragmatic  information  will  be  added  gradually,  but 
even  then  the  domain-related  information  will  be  kept  at  the  most  general  level  possible  so  that 
the  results  could  retain  a  maximum  universality.  As  an  example,  consider  the  following  short 

paragraph  excerpted  from  a  college  textbook  of  physics: 

In  electricity  the  isolated  charge  q  is  the  simplest  structure  that  can  exist.  If  two  such  charges  of 
opposite  sign  are  placed  near  each  other,  they  form  an  electric  dipole,  characterized  by  an  elec- 
tric dipole  moment  d.  In  magnetism  isolated  magnetic  poles,  which  would  correspond  to  isolated 
electric  charges,  apparendy  do  not  exist  The  simplest  magnetic  structure  is  the  magnetic  dipole, 
characterized  by  a  magnetic  dipole  moment  \i.  (pp.  823-824) 

Lxx)king  at  the  first  two  sentences  of  this  paragraph,  there  is  a  clear  remote  co-reference  link 
between  them  involving  the  phrases  the  isolated  charge  q  and  two  such  charges  of  opposite  sign. 
The  first  of  these  sentences  introduces  a  concept  of  the  isolated  charge,  at  some  initial  reference 
level  Lq.  In  the  second  sentence,  however,  we  change  the  reference  level  to  some  lower,  or  more 

detailed,  level  L  j  where  we  address  a  pair  of  instances  of  this  concept.   Note  that  the  second 

sentence  is  still  a  general  one:  it  does  not  refer  to  any  specific  situation,  rather  it  describes  a  type 
of  event  that  may  or  may  not  have  any  specific  extensions.  If  we  were  to  talk  about  such  an 
extension,  we  would  have  to  descend  to  a  yet  lower  reference  level,  L  ,,  with  a  pair  of  charges 
located  with  respect  to  time  and  space,  and  perhaps  some  other  factors.  These  "other  factors"  are 
quite  essential  here,  and  we  shall  refer  to  them  as  normality  conditions.  Normality  conditions 
actually  determine  which  of  the  spatio-temporally  located  pairs  of  charges  can  be  counted  as 
creating  instances  of  the  generic  event  described  on  the  upper  reference  level.  Although  some 
constraints  are  explicitly  set  in  the  generic  event  description  (placed  near  each  other,  of  opposite 
sign),  some  other  are  impliciUy  "understood"  (no  insulator  between  charges,  etc.).  Further 
analysis  of  the  rest  of  the  sample  text  could  be  continued  along  similar  lines. 

6.  Conclusion  ^ 

The  area  of  inter-sentential  dependencies  in  discourse  has  been  given  varying  degrees  of 
attention  in  linguistics,  philosophy  of  language  and  in  artificial  intelligence  research,  see,  for 
example,  (Cohen  1978),  (Partee  1978),  (Sidner  1979),  (Webber  1979),  (Grosz  1981),  (Hirst 
1981),  (Brown  and  Yule  1984)  and  (Hinrichs  1986).  Formal  linguistic  and  philosophical 
approaches  to  discourse  analysis,  while  usually  aiming  at  broader  description  of  linguistic 
phenomena,  normally  are  not  directly  suitable  as  a  basis  for  a  computational  theory  of  natural 
language  processing.  Computational  linguistic  research,  on  the  other  hand,  remained  mostly 
application  oriented  and  thus  offered  a  limited  range  of  solutions.  In  general,  we  observe  that 
the  research  in  the  field  of  inter-sentential  dependencies  in  discourse  has  not  gone  far  beyond  a 
limited  domain  of  anaphoric  in-text  references.  Even  in  this  limited  domain,  however,  there  is  a 
tendency  to  disregard  cases  where  utterances  have  other  than  singular  and  extensional  readings. 
Thus  it  comes  as  no  surprise  that  various  proposed  representations  are  not  as  adequate  and  accu- 
rate as  they  should  be.  The  present  research  seeks  to  avoid  some  of  the  above  problems  by  a 
more  careful  selection  of  the  meaning  representation  language,  as  well  as  by  taking  a  broader, 
more  comprehensive  approach  to  the  problem  of  inter-sentential  dependencies. 


'  Holiday  and  Resnick ,  P  hysics  for  Sludenls  of  Science  and  Engineering,  John  Wiley  &  Sons,  Inc.,  New  York,  London,  1963. 
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